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The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and wilt expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 

- Any reply received by the Office later than three months after the mailing date of this communication, even If timely filed, may reduce any 
eamed patent term adjustment See 37 CFR 1.704(b). 

Status 

1 )S Responsive to communlcation(s) filed on 07 April 2003 . 
2a)S This action is FINAL. 2b)n This action is non-final. 

3) n Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 
Disposition of Claims 

4) ^ Claim(s) 1-25 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) n Claim(s) is/are allowed. 

- -^^ Claim(s) 1-25 is/are rejected. 

Claim(s) ]s/are objected to. 

8) n Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) 0 The specification is objected to by the Examiner. 

10) 0 The drawing(s) filed on is/are: a)n accepted or b)^ objected to by the Examiner, 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

1 1) n The proposed drawing correction filed on is: 3)0 approved b)n disapproved by the Examiner. 

If approved, corrected drawings are required in reply to this Office action. 

12) 0 The oath or declaration is objected to by the Examiner. 
Priority under 35 U.S.C. §§119 and 120 

13) n Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 

a)nAII b)n Some*c)n None of: 

1 Certified copies of the priority documents have been received. 

2. n Certified copies of the priority documents have been received in Application No. . 

3. n Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

14) 0 Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 119(e) (to a provisional application). 

a) D The translation of the foreign language provisional application has been received. 

15) n Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121. 
Attachment(s) 

1) O Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-413) Paper No(s). . 

2) n Notice of Draftsperson's Patent Drawing Review (PTO-948) 5) [H Notice of Infomnal Patent Application (PTO-152) 

3) n Information Disclosure Statement(s) (PTO-1449) Paper No(s) . 6) □ Other: 
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DETAILED ACTION 



Response to Arguments 



1 . Applicants arguments filed 4/7/03 have been fully considered but they are not 
persuasive. It is the contention of the Examiner the cited references do in fact teach 
Applicants invention, and therefore the rejection stands. 

2. Regarding Applicants arguments on page 3 of the Amendment dated 4/7/03, the 
Examiner again refers to Figure 2. When the next sequential image 200 sub N comes 
in, the mosaic still displays "context images" or past images. The latest image is 
considered the active image. Clearly, Kumar teaches that a mosaic (multiple images 
viewable together) can include past images, or context images, and the latest images, 
or active images. Motion could be present in both, should there be no motion, the 
context images will be presented as static. 



3. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a 
foreign country or in public use or on sale in this country, more than one year 
prior to the date of application for patent in the United States. 



Claim Rejections - 35 USC § 102 



* 
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4. Claims 1-25 are rejected under 35 U.S.C. 102(e) as being clearly anticipated by 
U.S. Patent No. 5,963,664 to Kumar et al. 

5. As for Claims 1,13,18, and 23-25, Kumar discloses (Fig. 2) a set of temporally 
sequential frames of visual data, each frame representing an image, defining a region, 
within a panoramic region. Further disclosed (Fig. 2) is the positioning of one or more 
images, with relationship to the spatial orientation of the panoramic region, while an 
active image is being displayed. In addition, (Fig. 1, Element 106) shows an output 
device, which could be any type of video display. Kumar (Fig. 1) also shows the use of 
multiple cameras, which would provide at least two non-coincidental images, as well as 
a plurality of sets of temporally sequential frames, as further disclosed in Claim 13. Also 
disclosed in Claim 13 is the identification of a branch point, for the purpose of updating 
an image. Kumar discloses (Col. 17, Lines 13-33) a scene change detection scheme. 

6. As for claim 25, note the scene change is detected between temporally 
sequential images, and the new set of frames is the updated set of frames (Col. 7). 

7. Further disclosed in Claim 24, is a readable storage medium, on which is stored 
one or more computer programs, for producing a visual display, of a panoramic region. 
Kumar discloses (Col. 4, Lines 58-61) and (Col. 5, Lines 15-17) a computer that is 
programmed to function as an image processing system, and a video storage and 
retrieval system. 

8. As for the additional limitations of claims 1 , 23, and 24, see Figures 8 and 1 1 , 
The image with motion of Figure 8, and an active image are one in the same. The 
motion for successive frames of the image is determined by differencing the overlapping 
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data from frame to frame. Referring to Figure 11 , as an object moves through the 
scene from right to left, it will be displayed at each location. Previously displayed 
images of the moving object will no longer be active images because they will no longer 
have motion associated with them, and will therefore be replaced by static context 
images, of the background scene. 

9. Claim 2 discloses one or more context images, being automatically displayed, in 
a predetermined manner. Kumar teaches (Fig. 7), (Col. 11, Lines 1-3) a hierarchical 
technique to register images. 

10. Claims 3-4, disclose an order, in which context images are to be displayed. 
Since the frames representing an image are processed sequentially, and a hierarchy for 
how those images are displayed, already exists, it is logical to assume that the context 
images would be displayed, as disclosed in Claims 3-4. 

11. As for Claims 1 5 and 20, Kumar discloses (Col. 5, Lines 7-9) a single camera 
providing temporally sequential frames of visual data, while the camera pans across the 
scene, or "rotates at a fixed location". 

12. As for Claim 16, Kumar discloses (Col. 4, Lines 58-61) and (Col. 5, Lines 15-17) 
a computer that is programmed to function as an image processing system, and a video 
storage and retrieval system. 

13. In reference to Claims 5-12, Kumar discloses (Col. 4, Lines 58-61) and (Col. 5, 
Lines 15-17) a computer that is programmed to function as an image processing 
system, and a video storage and retrieval system. The use of computer software, and a 
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memory, implies that past and present images can be designated, by user instruction, to 
perform all functions disclosed in Claims 5-12. 

14. Although Claims 21-22 do not disclose user interaction, or image designation, by 
a user, they do refer to displaying context images, in a specific manner. It is therefore 
implied, that these displays could not take place, without instruction, and are rejected, 
for the same reasons as Claims 5-12. 

15. Regarding Claims 14 and 19, Kumar teaches (Fig. 2, Element 204) that each 
overlapping section, of an image, is updated by the new image. The fact that images 
can be displayed, while being produced, suggests that an active image is produced in 
real time. 



1 6. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of 



Conclusion 
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the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to George A Bugg whose telephone number is (703) 305- 
2329. The examiner can normally be reached on Monday-Thursday from 7:30 to 6:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Christopher S Kelley, can be reached on (703) 304-4856. The fax phone 
number for the organization where this application or proceeding is assigned is (703) 
308-5359. 

Any inquiry of a general nature or relating to the status of this application or 
proceeding should be directed to the receptionist whose telephone number is (703) 305- 
4750. 

George A Bugg 



Examiner 
Art Unit 2613 




GAB 



June 25, 2003 



